A nonmonotone line search method for noisy minimization
نویسندگان
چکیده
is satisfied, where σ is the noise level. Alternatively, the algorithm terminates when the maximum number of 400 ·n function evaluations is exceeded. For each problem, a series of 50 independent runs are conducted. We considered a test run successful if the stopping criterium (1) is satisfied before exceeding the maximal number of function evaluations. To compare the performance of methods from the set of methodsM over the set of problems P, the following indices (see [3]), for each method i are used. Let us denote by P̃ = {j ∈ P|∃i ∈ M, Nij > 0}, Pi = {j ∈ P|Nij > 0}, Mj = {i ∈ M|Nij > 0}, with Nij being the number of successful runs out of 50 for the method i solving the problem j. Then we have:
منابع مشابه
A Truncated Newton Method with Nonmonotone Line Search for Unconstrained Optimization
In this paper, an unconstrained minimization algorithm is defined in which a nonmonotone line search technique is employed in association with a truncated Newton algorithm. Numerical results obtained for a set of standard test problems are reported which indicate that the proposed algorithm is highly effective in the solution of illconditioned as well as of large dimensional problems.
متن کاملA derivative–free nonmonotone line search technique for unconstrained optimization
A tolerant derivative–free nonmonotone line search technique is proposed and analyzed. Several consecutive increases in the objective function and also non descent directions are admitted for unconstrained minimization. To exemplify the power of this new line search we describe a direct search algorithm in which the directions are chosen randomly. The convergence properties of this random metho...
متن کاملNonmonotone Spectral Projected Gradient Methods on Convex Sets
Nonmonotone projected gradient techniques are considered for the minimization of differentiable functions on closed convex sets. The classical projected gradient schemes are extended to include a nonmonotone steplength strategy that is based on the Grippo-Lampariello-Lucidi nonmonotone line search. In particular, the nonmonotone strategy is combined with the spectral gradient choice of stepleng...
متن کاملNonmonotone derivative-free methods for nonlinear equations
In this paper we study nonmonotone globalization techniques, in connection with iterative derivative-free methods for solving a system of nonlinear equations in several variables. First we define and analyze a class of nonmonotone derivative-free linesearch techniques for uncon-strained minimization of differentiable functions. Then we introduce a globalization scheme, which combines nonmonoton...
متن کاملNonmonotone Convergence and Relaxing Functions
In the minimization of real valued functions, Newton’s algorithm is often combined with a line search method. Grippo et al [SIAM J. Numer. Anal., Vol. 23, No. 4] first suggested a nonmonotone stepsize selection rule based on the maximum of a fixed set of previous function values. In this paper we introduce the notion of relaxing functions and suggest several other nonmonotone procedures using a...
متن کاملThe Riemannian Barzilai-borwein Method with Nonmonotone Line-search and the Matrix Geometric Mean Computation
The Barzilai-Borwein method, an effective gradient descent method with cleaver choice of the step-length, is adapted from nonlinear optimization to Riemannian manifold optimization. More generally, global convergence of a nonmonotone line-search strategy for Riemannian optimization algorithms is proved under some standard assumptions. By a set of numerical tests, the Riemannian Barzilai-Borwein...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Optimization Letters
دوره 9 شماره
صفحات -
تاریخ انتشار 2015